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Face Detection plays a crucial role in identifying individuals and criminals in 
Security, surveillance, and footwork control systems. Face Recognition in 
the human is superb, and pictures can be easily identified even after years of 
separation. These abilities also apply to changes in a facial expression such 
as age, glasses, beard, or little change in the face. This method is based on 
150 three-dimensional images using the Bosphorus database of a high range 
laser scanner in a Bogaziçi University in Turkey. This paper presents 
powerful processing for face recognition based on a combination of 
the salient information and features of the face, such as eyes and nose, 
for the detection of three-dimensional figures identified through analysis of 
surface curvature. The Trinity of the nose and two eyes were selected for 
applying principal component analysis algorithm and support vector machine 
to revealing and classification the difference between face and non-face. 
The results with different facial expressions and extracted from different 
angles have indicated the efficiency of our powerful processing. 
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1. INTRODUCTION 


Face detection has great importance for many as groups. The crucial applications of Face Detection 


in areas such as human-computer interface, human authentication, criminals face detection, face monitoring 
systems is undeniable. In all methods proposed to determine the position of specific points in three- 
dimensional images, the nose is regarded as a typical point, and the rest of the points can be located. 
To determine the location of the nose, several methods were proposed. In some methods, the nearest position 
of the camera is regarded as the nose, and then the other points are extracted based on the nose position. 
This assumption is true in the case of no rotation around the x and y-axis; in fact, the image must be on 
the front side. 

Xu et al. [1] introduced a feature extraction hierarchical plan to identify the positions of the nose tip 
and nose ridge. 

They presented an effective energy idea to show the local distribution of neighboring points and 
detect the candidate nose tips. 

In the end, a support vector machine (SVM) classifier was used to choose the right nose tips. 

Dibeklio’ glu et al. [2, 3] displayed strategies for recognizing facial information on 3D facial datasets 
to empower posture amendment under important posture varieties. 
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They presented a statistical strategy to distinguish facial elements using the gradient of the depth 
map based on preparing a model of local elements. The technique was tried against the FRGC v1 and 
the Bosphorus databases; however, information with posture varieties was not taken into the investigation. 

They likewise presented a nose tip localization and segmentation technique utilizing curvature- 
based heuristic investigation. Also, even though the Bosphorus database utilized comprises of 3,396 facial 
scans, they are acquired from 81 subjects. At last, no correct localization distance error results 
were displayed. 

In other research, Romero-Huertas et al. [4] introduced a graph matching method to determine 
the places of the nose tip and internal eye corners. They presented the distance to local plane idea to portray 
the local distribution of neighboring points and identify convex and concave regions of the face. At long last, 
after the graph matching method has wiped out false landmarks, according to the minimum Mahalanobis 
distance, the best combination of landmarks points is chosen to the trained landmark diagram model. 
The technique was tried against FRGC v1 and FRGC v2 databases, including 509 scans and 3271 scans, 
respectively. They detailed a considerable rate of 90% with thresholds for the nose tip at 15 mm, and for 
the internal eye corners at 12 mm. 

At last, Perakis et al. [5, 6] displayed techniques for distinguishing important facial points such as 
eye inner and outer corners, mouth corners, and nose and chin tips) based on 2.5D scans. Neighborhood 
shape and curvature processing using shape index, expulsion maps, and turn pictures were utilized to find 
candidate landmark points. These are determined and marked by coordinating them with a statistical facial 
landmark model [7, 8]. 

The goal of this paper is to find out an efficient face registration method based on triple.Then we 
will introduce the problems related to the existing systems in face recognition and possible research ways that 
help to solve these issues. Three dimensional methods could provide better robustness to create diversity than 
2D-based methods. Automatic face recognition detection has become one of the most important research 
topics in image processing due to its application in human-robot interactions, pain detection, lie detection, 
and other psychological and medical applications. 


2. MATERIAL AND METHOD 

In this method, it is assumed that a true display of a three-dimensional image as a piece of the image 
for each location (j, 1) coordinates (X, Y, Z) the three-dimensional scene. Some of the images received from 
the device illustrate the data on a form of polygon models, usually called the triangular model. In this case, 
the range of the image can be detected using the Z-buffer algorithm [1]. As a result, the resulting image may 
include any number of faces; in that case, it depends on the need and also the imaging device. To avoid 
the less computational problem, we first seek facial features such as eyes and nose. As a result, this is the first 
step in image segmentation in related areas of the face features. 

Currently, our goal is to distinguish the face triangle on real faces. This method is registered for 
the position and standard orientation of the face and reduction of the variability of the depth of the face. 
The triangle distance of the nose and eyes in the image is also calculated. 


2.1. Nose and eyes identification 

The HK segmentation method is used to find the nose and the inner corners of the eyes. 
For a surface, with a curvature H mean and K Gaussian curvature, the facial expression can be identified. 
In this case, the nose is the maximum point, and the corners of the eyes are the minimum. Based on 
the average curvature of the face, and because of the leading position and hilly of the nose, it has the highest 
curvature in the surrounding area, so regarding the face, the points with the maximum curvature are searched. 
For this purpose, the mean surface curvature is calculated. Afterward, the areas with a greater curvature 
specified and the area with the greatest curvature will be the tip of the nose. If the curvature of an area is 
greater, therefore the total amount of curvature in the area will be more obvious. In addition to that, because 
of the noise, Curvature enhances in one or several pixels, but the high curvature of the searched area is 
curved, the filter reduces the noise and averages the effects of preventing the wrong location by calculating 
the mean [9]. The image of the mean curvature, before and after the filtering is shown in Figure 1. 

This method determines the position of the nose under any desired angle around the x, y, and z. 
The only limitation is more likely if more than half of the nose is hidden around the y-axis. This method 
utilizes the mean curvature of the face and does not take advantage of the educational and classified data. 
For this reason, this method has a higher computational speed than the methods that find the nose from 
different angles. 
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Figure 1. The front part of the face (top right), the image of average curvature (top left), the front part of 
the face with more light intensity (bottom left), the image of the average curvature after 
filtering (bottom right) 


2.2. Recognition in image rotation 

The computational cost of the use of the rotating image is high. Initially, a series of areas that are 
likely to locate the nose and eyes are specified, then to locate the exact area, the rotating image is extracted, 
and using SVM (Support Vector Machine) classification, the exact located is specified [10, 11]. This method 
needs primary data and a neural network. To determine the location of the nose, the angles around the y-axis 
is quantized, and then the images rotate around the y-axis, then the nearest point to the camera is considered 
as a candidate. After a full rotation around the y-axis, the nose is diagnosed. This method can identify 
the nose position if the rotation is around the y-axis, and this method is not cost-effective if the rotation 
happens to the other angles. 


2.3. Three-dimensional face rotation 

Three rotational matrices or their multiplied structure can be used to rotate three-dimensional 
images around the axes of rotation [12-14]. If we assume that alpha is rotation around axis X, Beta is rotation 
around axis Y, and Lambda is rotation around the axis of Z, then the formula around each axis will be as (1) 
to (3). In formula (4) the result is the by multiplying form of the three matrices: 


1 0 0 
R,(a@) = |0 Cosa —Sina (1) 
0 Sina Cosa 
CosB 0 Sing 
ra=] 0 1 0 | (2) 
—SinB Sina CosB 
Cosy —Siny 0 
R3(y) =|Siny 1 0 (3) 
0 0 1 
R = R; * R, * R} = 
Cosß. Cosy —Cosf. Siny Sinf 
Sina. Sinfp.Cosy + Cosa. Siny —Sina.SinB.Siny + Cosa. Siny —Sina. CosB (4) 
—Cosa. Sinf. Cosy + Sina. Siny Cosa.SinB.Siny + Sina.Cosy Cosa.Cosy 





As a result, vectors on each spin is obtained with the coordination of the rotated image. 
The intensity is added to use this matrix, three-dimensional data, and two-dimensional image rotation. So, 
the image rotation coordination is found. The data matrix is changed as formula (5), and the intensity was 
added to the last line of image data. 
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The important point here is that two and three-dimensional images of the same size, and both must 
be accurate with a complete picture of the interaction compliance. The database used; the two-dimensional 
images are larger than the three-dimensional images. Therefore, first two-dimensional images are resized to 
be the same size with dimensions of three-dimensional images. After that, a common point in both images is 
marked, and two images are characterized by y and x overlap, then the data is available for each 
coordination [15, 16]. Due to the change of the data matrix, a rotation matrix also needs to be changed. 
Since the intensity data does not affect the pixel location, the rotation matrix will be as formula (6). 

Where the available zero and one data are added to the rotation matrix, so the light intensity data is 
transmitted without altering. 


0 
0 

om ©) 
1 


Then the collected data in a two-dimensional matrix are transformed into a two-dimensional rotated 
image [17]. 


2.4. Face detection 

The use of information procedure has several advantages. First of all, the first data is for the depth, 
not the intensity of the light, so independent of the severity of the light or the light radiation angle or the face 
size, the obtained image is fixed. Also, these data do not use the reflected light from the face. Therefore, it is 
not dependent on the skin color changes affected by the makeup or sunlight and sunburn. Generally, 
the three-dimensional data can be moved and rotated in the desired angle in three-dimensional space; 
accordingly, the formula is extracted under the desired angle. Therefore, if the image is not at the desired 
angle, it can be rotated to calculate the image at the desired angle [18-20]. 

The need for three-dimensional imaging cameras, which are more expensive than two-dimensional 
imaging cameras, is one of the disadvantages of this method. Facial hair is one of the cases which makes 
the extraction of depth data difficult [20]. Due to the detection of faces by the trinity of eyes and nose, 
the system can get along with problems such as hiding the ear, hair, eyebrows, etc. (Figure 2). 





Figure 2. Face detection using nose and eyes 


The complete procedure can be extracted through a panoramic camera or multiple photos in 
different directions. 





Powerful processing to three-dimensional facial recognition using ... (Mohammad Karimi Moridani) 


330 o ISSN: 2252-8814 


2.5. Experimental testing 

The proposed method implemented on the Bosphorus database on 150 faces shows that this method 
is 99.7% accurate in the diagnosis of the position of the nose, 99.3% correct diagnosis of the position of 
the eyes, and 96.7% accurate diagnosis of eye position. In Table 1, the results determine the location of 
the eyes, nose, and internal parts of the eyes, which were shown in the database. 


Table 1. The number of nose and eyes positions which were detected 
Left Eye Right Eye 








Viewing Angle Nose Detection Detection Detection 
Front Photo 143 141 139 
Rotate 25 degrees around Y 143 143 139 


Low rotation 


around the z-axis = a 14l 
High rotation 143 143 141 
around the z-axis 
Smile Picture 143 142 140 
Open Mouth 141 141 140 
The rotation around the x-axis (above) 143 143 141 
The rotation around the x-axis 142 142 
(down) 





3. RESULTS AND DISCUSSION 
The proposed algorithm is implemented on 14 pictures of 150 persons is shown in Table 2. 
In Figure 3 the accuracy graph is plotted for different errors. 


Table 2. Estimation accuracy of angle for various errors 
The error Z-Axis y-Axis x-Axis 
10° error. 21 98% 99.52% 98.81% 
6 ° Error 94.88% 98.81% 92.33% 
3 ° Error 71.46% 95.00% 67.24% 
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Figure 3. Accuracy diagram for different errors 


The running time of this Algorithm, regardless of the time needed to determine the location of 
the nose, is less than 800 milliseconds. Moreover, this method requires no data for training. Because of 
the hierarchical structure in case of the wrong estimation of the angles, the wrong estimation of the other 
angles is also possible. Due to the data mapping of the Z = 0, the existence of an error in the calculation of 
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the angle in the direction of the z-axis is possible. If we can calculate parameters using the ellipse in three- 
dimensional space, then the accuracy can be increased. Also, if the angle along the x-axis and y can be 
determined from the original image along with the angle determination, then the Speed and error of 
the method will be decreased. 

One of the most important capabilities of the human visual system is the ability to recognize 
the face, which plays an important role in the social life of each person. Our relationship with other people is 
based on our ability to identify them. One of the most prominent aspects of the human face recognition 
system is its high accuracy and reliability, but all human beings do face recognition easily and without much 
effort, while this is not an easy task for computers. The main purpose of this study is to study the effect of 
selecting the appropriate features of three-dimensional images for face recognition. The results show 
the success of this method in identifying faces with different characteristics. Different approaches so far are 
summarized in Table. 3. 


Table 3. Comparison of classification accuracy of different methods 








Name 3D face database Nau 
Accuracy 
Blanz et al [21] FRGC 92% 
Dibeklioglu et al [22] Bosphorus 79.41% 
Mahmood et al [23] GavabDB 90% 
Berretti et al [24] UND FRGC v2.0 GavabDB 82.1% 
Perakis et al [25] UND — 
Ding et al [26] LFW 92.95% 
Proposed method Bosphorus 99.52 % 





Due to the sensitive nature of face detection, high precision is of the utmost importance. 
Obtained results show that the open mouth increases the possibility of the loss of the nose. Considering that 
this method is not only to identify the nose and eyes identification are also considered, so this weakness is 
covered, but in the situation in which both eyes are covered or somehow that part of the image is lost or if 
the mouth is open; the identification will be less than when the mouth is closed. 


4. CONCLUSION 

Human face recognition by machine through 3D images has become an active research phase in 
image processing communities, pattern recognition, neural networks, and computer vision. 

The face plays an essential role in identifying people and showing their feelings at the community 
level. The human ability to recognize faces is remarkable. We can recognize thousands of memorable faces 
in our lifetime and, at a glance, recognize familiar faces even after years of separation. Face recognition 
has become an important issue in applications such as security systems, credit card control and 
crime identification. 

In this article, a new method to face recognition automatically using 3D face images was presented. 
The geometric features of the face were used to identify faces with the help of neural networks. The results 
showed. The results of using the proposed method in this paper with the help of Bosphorus database showed 
the highest percentage of accuracy compared to previous methods. 
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